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The  Equivalence  of 

Dantzig’s  Self-Dual  Parametric  Algorithm  for  Linear  Programs 
to  Lemke’s  Algorithm  for  Linear  Complementarity  Problems 
Applied  to  Linear  Programs 


Irvin  J.  Lustig 

Department  of  Operations  Research 
Stanford  University 


ABSTRACT 


Dantzig  has  asserted  that  his  self-dual  parametric  algorithm  for  solving  a  linear  pro¬ 
gram  is  equivalent  to  Lemke’s  method  for  solving  a  linear  complementarity  problem  when 
the  latter  is  applied  to  solve  a  linear  program.  In  this  paper,  we  formally  prove  that 
Dantzig’s  assertion  is  correct — specifically  that  the  point  reached  along  the  solution  path 
after  2 1  iterations  of  Lemke’s  method  is  identical  with  the  point  reached  after  t  iterations 
of  Dantzig’s  method. 
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1.  Introduction 

Dantzig  (1963,  Chapter  11)  introduced  his  self-dual  parametric  algorithm  to  solve  the 
linear  program 


minimize  cFx 
subject  to  Ax  >  b 
x  >  0, 

which  is  equivalent  to  solving  the  linear  complementarity  problem 

(-.*)*  (i  :)(:)-(:)• 

uTy  +  vTx  -  0, 
u,v,z,y  >  0. 


(l.lo) 

(1.15) 

(1.1c) 


(1.2a) 

(1.25) 

(1.2c) 


Ravindran  (1970)  credits  Dantzig  with  the  claim  that  the  solution  path  resulting  from 
the  application  of  the  self-dual  algorithm  to  the  linear  program  (1.1)  corresponds  to  the 
one  obtained  by  applying  Lemke’s  (1965)  algorithm  to  the  linear  complementarity  problem 
(1.2).  Ravindran  developed  a  modified  form  of  Lemke’s  algorithm  which  he  proved  has  a 
solution  path  that  corresponds  to  the  self-dual  algorithm.  He  stated  “since  our  method 
is  a  condensed  form  of  Lemke’s  method  in  some  sense,  we  have  also  shown  that  Dantzig’s 
claim  may  be  valid.”  However,  Ravindran  never  proved  that  his  method  was  equivalent  to 
Lemke’s  algorithm. 

McCammon  (1970),  in  his  Ph.D.  thesis  at  Rensselaer  Polytechnic  Institute,  considered 
Dantzig’s  claim  as  well.  He  presented  his  own  parametric  pivoting  method  for  general  linear 
complementarity  problems  of  the  form 


of  which  (1.2)  is  a  special  case.  McCammon*  proved  that  his  algorithm  is  equivalent  to 
Lemke’s  algorithm  applied  to  (1.3).  McCammon,  however,  believed  that  the  solution  path 
of  his  algorithm  did  not  correspond  to  that  of  Dantzig’s  self-dual  algorithm.  In  the  last 
section  of  Appendix  II  of  his  thesis,  he  applied  his  algorithm  and  Dantzig’s  algorithm  to  a 
numerical  example  in  order  to  show  that  the  two  solution  paths  need  not  correspond.  A 
careful  examination  of  his  calculations  indicates  that  he  applied  the  two  algorithms  to  two 
different  linear  programs. 

Section  2  of  this  paper  gives  a  brief  description  of  each  of  the  algorithms;  Section  3 
contains  a  formal  proof  of  Dantzig’s  claim  by  showing  how  each  of  these  algorithms  when 
applied  to  the  same  problem  follow  corresponding  solution  paths;  Section  4  illustrates  the 
proof  with  a  simple  example. 

2.  Algorithm  Descriptions 

In  order  to  simplify  the  discussion,  we  make  the  non-degeneracy  assumption  that  the  linear 
program  (1.1)  has  no  primal  or  dual  degenerate  vertices.  Otherwise,  when  a  ratio  test  is 
performed  in  each  method,  the  same  rules  must  be  used  to  break  ties.  The  equivalence  of 
these  rules  is  then  clear  by  their  construction. 

The  self-dual  algorithm  is  initialized  for  the  linear  program  (1.1)  by  arbitrarily  choos¬ 
ing  any  vectors  /  >  0  and  d  >  0  and  scalar  0  >  0  sufficiently  large  so  that  —  6  +  0f  >  0 
and  c  +  0d>  0.  The  parametric  linear  program 


minimize  (c  +  0d)Tx 

(2.1a) 

—Ax  +  u  =  —b  +  0f 

(2.16) 

x,u  >  0 

(2.1c) 

has  x  =  0  and  u  =  —  6  +  $f  as  an  optimal  basic  primal  feasible  solution  for  all  sufficiently 
large  6  >  0.  The  self-dual  algorithm  lowers  0  to  some  critical  value  0$,  such  that  for  a  small 

*  A  short  description  of  McCammon’a  algorithm  (without  proof)  is  given  by  Lemke  (1970),  pp.  359 
361.  I  find  McCammon ’s  proof  and  the  statement  of  his  algorithm  somewhat  unclear.  It  is  possible  that  his 
algorithm  is  equivalent  to  Cottle’s  (1972)  parametric  pivoting  algorithm.  Cottle’s  algorithm  is  well-defined 
when  M  has  positive  principal  minors  or  M  is  positive  semi-definite.  If  they  are  equivalent,  then  it  is  not 
clear  whether  McCammon  realised  the  necessity  of  having  assumptions  on  the  properties  of  M  in  order  to 
make  his  algorithm  well-defined. 


c  >  0  uid  0  «  $o  —  «,  the  current  solution  to  (2.1)  is  either  primal  or  dual  infeasible  for 
exactly  one  primal  or  dual  variable,  by  the  non-degeneracy  assumption.  If  primal  (dual) 
infeasibility  occurs,  then  the  dual  (primal)  simplex  method  is  invoked  for  one  iteration  on 
(2.1)  with  9  =  0O.  The  theory  states  that  0  can  then  be  lowered  to  a  value  less  than  0o 
while  preserving  feasibility.  This  allows  the  procedure  to  be  iteratively  repeated,  stopping 
at  some  iteration  when  0  =  0  is  reached  or  0  =  0*  >  0  is  reached  below  which  0  cannot  be 
lowered.  In  the  latter  case,  (2.1)  is  either  primal  or  dual  infeasible  (or  both). 

Lemke’s  algorithm  is  initialized  for  (1.2)  by  choosing  the  same  /  and  d  as  in  the 
self-dual  method  and  writing 

(^)  +  (rf)J+(-AT  o)(50  =  (“)’  (2U) 

uTy  +  vTx  =  0,  (2.16) 

(2.1c) 

For  all  sufficiently  large  0,  u  =  —  6  +  0/  >  0,  v  =  c  +  0d  >  0,  x  =  y  =  0  is  a  basic 
feasible  solution  to  (2.1).  The  variable  pairs  (xj,  Vj)  and  (u;,  yi)  are  termed  complementary. 
Lemke’s  algorithm  first  makes  the  nonbasic  artificial  variable  0  basic  by  first  decreasing  its 
value  from  +oo  to  some  critical  value  0  =  9q  at  which  some  basic  variable  becomes  0  and  is 
replaced  by  0  as  a  basic  variable.  0  remains  basic  from  this  point  on  until  its  value  in  some 
subsequent  basic  solution  is  reduced  to  zero.  The  complement  of  the  variable  that  exited 
from  the  set  of  basic  variables  becomes  on  the  next  iteration  the  new  entering  nonbasic 
variable.  This  new  variable  is  made  basic  by  pivoting  out  some  other  basic  variable,  while 
leaving  all  the  other  basic  variables  nonnegative  and  maintaining  a  solution  to  (2.1).  The 
complement  of  the  variable  just  pivoted  out  becomes  the  new  entering  nonbasic  variable 
and  the  procedure  is  continued  in  this  way,  maintaining  an  almost  complementary  form 
until  either  0  exits  the  basis  at  0  =  0  or  no  basic  variable  blocks  the  increase  of  the  incoming 
nonbasic  variable,  in  which  case  the  linear  program  is  either  primal  or  dual  infeasible  (or 
both). 

It  is  important  to  understand  that  the  self-dual  algorithm  manipulates  only  the  data 
of  the  matrix  A  of  the  primal  linear  program  while  Lemke’s  algorithm  operates  both  on 


the  A  matrix  of  the  primal  and  the  AT  matrix  of  the  dual  problems.  Hence,  one  pivot 
in  the  self-dual  algorithm  which  explicitly  exchanges  the  role  of  a  basic  and  non-basic 
primal  variable  implicitly  exchanges  two  corresponding  dual  variables  as  well.  The  set  of 
basic  variables  for  the  self-dual  method  highlights  the  m  primal  basic  variables  and  treats 
the  n  basic  dual  variables  implicitly.  For  Lemke’s  method,  the  set  of  basic  variables  is  a 
collection  of  some  (m  +  n  —  1)  primal  and  dual  variables  of  the  original  problem  and  9.  In 
the  self-dual  algorithm,  when  Xj  enters  (leaves)  the  set  of  basic  variables,  its  complement 
Vj  implicitly  leaves  (enters)  the  set  of  basic  variables.  Similarly,  when  tij  leaves  (enters) 
the  basic  variable  set,  its  complement  implicitly  enters  (leaves)  that  9et.  In  Lemke’s 
method,  all  of  the  components  of  x,  u,  v,  y  are  explicitly  involved  in  the  pivot  process. 
When  a  variable  (e.g.,  tij)  leaves  the  set  of  basic  variables,  its  complement  (e.g.,  yj)  must 
enter  that  set  on  the  next  iteration. 

3.  Proof  of  Equivalence 

To  show  the  equivalence  of  the  self-dual  algorithm  and  Lemke’s  algorithm  applied  to  the 
linear  programming  problem,  the  algebraic  expressions  of  the  terms  of  the  simplex  tableaus 
of  each  method  and  their  updates  are  presented  in  such  a  way  that  their  correspondence 
is  clear.  We  assume  that  A  G  &mxn,  b  €  £m,  and  c  €  3fn.  Hence  the  primal  vector  x  is  an 
element  of  3fcn,  and  the  dual  vector  y  is  an  element  of  9fcm.  Note  that  u  6  3Jm  and  v  €  9?n. 

The  simplex  tableau  for  the  self-dual  method  is  initialized  as  follows: 


*1*  •  •  •  * 

«1  )•••)  um 

RHS 

FBAR 

-A 

I 

-b 

/ 

Mm 

2 

c 

0 

DBAR 

d 

0 

8  =  +oo 

Tableau  3.1 


The  initial  basic  solution  is 


The  simplex  tableau  for  Lemke’s  method  is  initialized  in  a  form  that  simplifies  the 
algebraic  updating: 


til  !•••)  ^im 

t>l,...,t>„ 

Vm 

Xi,  . . . , xn 

9 

RHS 

t*l 

Im 

0 

0 

B 

E 

t>l 

0 

In 

at 

1 

I 

Vn 

H 

H 

Tableau  3.2 


The  initial  basic  solution  is 

TJsll]  nonba>i“  { i  =  o  <3-2> 

for  9  =  90.  The  inductive  hypothesis  for  the  proof  will  assume  that  at  iteration  t  of  the 
self-dual  method,  and  iteration  2 1  of  Lemke’s  algorithm,  each  method  has  performed  pivots 
and  exchanged  labels  of  complementary  pairs  of  variables  to  produce  Tableaus  3.1  and  3.2, 
respectively.  In  fact,  the  self-dual  method  tableau  will  correspond  exactly  to  Tableau  3.1, 
while  Lemke’s  method  will  have  the  variable  9  in  its  set  of  basic  variables  and  one  variable 
among  the  u,-  and  Vj  not  in  the  basic  set.  It  will  be  shown  that  6  can  be  pivoted  out  of  the 
canonical  form  of  Lemke’s  algorithm  at  its  current  value  and  a  non-basic  variable  pivoted 
into  the  basis  in  such  a  way  that  the  new  tableau  is  in  the  form  of  Tableau  3.2. 

Furthermore,  the  inductive  hypothesis  will  also  assume  that  —b+f9t  >  0  and  c+d6t  > 
0,  where  9t  is  the  value  of  9  on  iteration  t.  This  inductive  assumption  allows  both  methods 
to  restart  from  their  relabeled  tableaus. 


For  initialization,  both  methods  begin  with  0O  =  +00  and  decrease  9  =  9  to  some 
blocking  value  9  =  9  =  9\.  The  second  part  of  the  inductive  hypothesis  is  satisfied. 
Because  of  the  symmetry  between  the  primal  and  dual  linear  programs,  we  can  assume 


that  the  self-dual  method  will  do  a  dual-simplex  iteration  initially,  pivoting  out  some 
tij.  Similarly,  for  Lemke’s  method,  we  can  assume  that  9  will  enter  into  the  set  of  basic 
variables,  replacing  some  primal  variable  tt,.  Therefore,  just  before  pivoting  u,  out  of  the 
basis,  the  canonical  form  of  Tableau  3.1  and  Tableau  3.2  correspond  and  thus,  the  test 

““{jr:-  {x:/,>0}  ’i-w  { v di  >i °}}  (3-3) 

performed  by  Lemke’s  Method  is  seen  to  be  exactly  the  same  as  the  self-dual  test  and 
therefore  the  tij  chosen  to  exit  will  be  the  same.  Note  in  Tableau  3.2,  9  is  decreasing  from 
+oo. 

For  both  methods,  let  t'i  correspond  to  some  primal  slack  variable  u,-t  which  will  exit 
the  basis.  By  reordering  the  equations  of  the  primal  linear  program,  we  can  assume  that 
»i  =  l.  The  self-dual  method  will  set  9  =  bxffi,  and  Lemke’s  method  will  perform  a  pivot 
in  the  column  corresponding  to  9  and  the  row  corresponding  to  Uj.  This  pivot  will  cause 
9  to  be  made  basic,  replacing  «i,  and  will  set  9  =  —  6i/(— /i)  =  9. 

The  self-dual  method  will  now  perform  a  dual-simplex  ratio  test,  using  9  to  determine 
the  parametric  reduced  costs  c+d9 ,  when  9  —  bx/ f\: 

min  /  CJ  .  _  <  ol  =  min  { :  Ql  >  ol  (3.4) 

. »  l  an  1  J  j=i . «  (  fiaij  1  J 


Lemke’s  method  pivots  uj  out  of  the  basis,  and  its  complement,  yi,  is  required  to  be 
the  entering  variable.  The  components  of  RHS  for  Lemke’s  method  are,  when  9  =  b\/ fx\ 


'  h/fi  if  *  -  l; 

RHS(fc)=<  -bk  + fk(bi/fi)  if  fc  =  2, . . .  ,m; 

Cj  +  dj(bi/fi )  if  k  =  m  +  1, . . . ,  m  +  n;  j  =  k  -  m. 


(3.5) 


Because  the  coefficient  in  Tableau  3.2  in  the  (t*i,yi)  position  is  zero,  the  column  for 
yi  in  Tableau  3.2  remains  unchanged  after  the  pivot  in  the  (uj,0)  position.  Hence  the 
ratio  test  on  the  second  iteration  of  Lemke’s  algorithm  is  only  made  among  the  variables 
Vj,  j  =  1, . . . ,  n  and  is  therefore 

f  Cj  +  dj(bi/fi)  )  f  ficj  +  djb\  _  n\  /0 

. "  l  <*ij  1  J  J=i . »  l  fi°ij  J 
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This  is  the  same  test  as  the  test  (3.4)  done  in  the  self-dual  method.  By  reordering  the 
primal  variables,  we  can  assume  that  j  =  2  is  chosen  in  these  ratio  tests. 

The  pivot  for  the  self-dual  method  is  done  in  the  (ui ,  x2 )  position.  If  we  let  be  an 
elementary  matrix,  i.e.  an  identity  matrix  except  for  its  first  column  E\: 


Ei  =  — 

ai2 


/  "I  \ 
-022 


and  Ex=(ex  Jm  l  )  , 


V  ~am2  / 

where  Ip  is  a  p%p  identity  matrix,  the  new  tableau  is: 


1 

*!>•••> xn 

til  Spi 

RHS 

FBAR 

m 

H 

-Ei  A 

Ex 

-Eib 

Eif 

mm 

z 

(—02/012)01-  +  0 

(02/012)  0 

DBAR 

(— d2/a12)aj.  +  d 

(^/oi2)  0 

9  =  bi/fi 

Tableau  3.3 


where  aj.  denotes  the  first  row  of  A.  While  the  self-dual  method  has  done  a  pivot  on  the 
primal  linear  program,  it  implicitly  has  done  a  pivot  on  the  dual  linear  program.  The 
method  always  maintains  complementarity  between  the  primal  and  dual  solutions  in  the 
tableau.  Thus,  at  the  same  time  that  x2  entered  the  set  of  basic  variables,  replacing  u j, 
yi  implicitly  replaced  v2.  After  two  pivots  in  Lemke’s  method,  9  has  replaced  uj,  and  y\ 
has  replaced  t?2-  x2  is  now  the  variable  entering  into  the  set  of  basic  variables.  We  will 
now  show  that  the  Lemke  system  can  be  pivoted  in  such  a  way  that  x2  replaces  9,  and  the 
bases  between  the  two  methods  will  correspond  again  after  this  pivot.  Later  we  will  show 
that  Lemke’s  method  uses  x2  as  the  driving  variable  to  choose  the  same  outgoing  variable 
as  the  self-dual  method,  while  9  remains  in  the  basis  the  entire  time  (until  optimality).  It 
is  now  time  for  the  first  lemma. 

Lemma  3.1.  In  Lemke’s  method,  after  two  pivots,  the  coefficient  in  the  x2  column  for  9 
is  positive.  In  other  words,  dB/dxj  <  0. 


Proof.  After  the  first  pivot,  the  desired  coefficient  a  =  — <*i2/(— /i)  =  a\if f\-  Since  the 
coefficient  in  the  first  row  in  the  column  for  y\  is  zero,  the  second  pivot  does  not  modify 
a.  Hence  a  remains  positive  since  a\%  >  0  and  f\  >  0  from  the  previous  ratio  tests  (3.3) 
and  (3.6).  | 

If  after  doing  the  first  two  pivots  of  Lemke’s  method,  we  pivot  on  this  nonzero  element 
a,  we  form  a  new  tableau  that  can  be  obtained  by  doing  a  block  pivot 

Vi  *2 

til  /  0  ~ <*12 

v2  \ai2  0 


on  Tableau  3.1.  This  is  the  same  as  performing  the  exchange  (v2,yi)  followed  by  (ui,x2)- 
This  is  done  by  setting 


£2  = 


<*12 


/-«n\ 

1 

—<*13 


'  aln  / 


and  E2  = 


/I 
0 

Vo 


Ei 


0 

0 

In-1 


(3.7) 


and  creating  the  following  tableau: 


tii  vi  um 

Ui,...,Vn 

6 

RHS 

«1 

Im 

0 

0  -A 

-b 

0 

e7 

EiAt  0 

-E2d 

Etc 

■ 

Tableau  3.4 


Then  we  exchange  «i  and  x2  by  pivoting  on  the  («i,x2)  element.  This  pivot  is  very 

t 


8 


similar  to  the  pivot  done  in  the  self-dual  method.  It  produces  the  following  system: 


Tableau  3.5 


This  is  a  valid  canonical  form  for  Lemke’s  method,  since  at  0  =  0X,  the  system  is  feasible. 
Lemke’s  method  can  be  started  from  Tableau  3.5  with  8  as  the  first  entering  variable.  By 
examining  Tableaus  3.3  and  3.5,  the  ratio  tests  to  find  the  primal  variable  blocking  the 
decrease  of  0,  i.e., 

rain  U-E,tM(E,/)i  :  (£,/),  >  0},  (3.8) 

1=1 

are  seen  to  be  the  same  for  both  methods.  Note  that  (£^c);  =  Cj  —  (aij/ai2)c2  for  j  ^  2, 
(E2c) 2  =  C2/ai2,  (~E2d)j  =  -dj  +  (aij/ai2)d2  for  j  ±  2,  and  (-E2d) 2  =  -<*2/012-  This 
corresponds  to  the  rows  CBAR  and  DBAR  in  Tableau  3.3.  Hence  the  ratio  test  to  find  the 
dual  variable  blocking  the  decrease  of  8 , 

min  {(E2c)j/(E2d)j  :  (Etd);  >  0},  (3.9) 

I-.  .,n 

is  the  same  for  both  methods.  We  have  now  proved  the  following: 

Lemma  3.2.  After  one  pivot  in  the  self-dual  method  and  two  pivots  in  Lemke’s  method, 
the  driving  variable  for  Lemke’s  method  can  be  pivoted  into  the  basis  for  0  such  that  the 
canonical  forms  of  the  new  systems  after  rearrangement  of  rows  and  columns  correspond 
to  Tableaus  3.1  and  3.2.  Each  method  can  be  restarted  from  its  respective  new  tableau. 

The  correspondence  in  Lemma  3.2  is  achieved  by  relabeling  the  variables  in  Tableaus 
3.3  and  3.5.  This  is  done  by  letting  the  m  primal  basic  variables  represent  u.  If  this  is 


done,  then  the  two  tableaus  correspond  to  the  same  linear  program,  which  is  in  a  new 
canonical  form.  The  new  form  is  equivalent  to  the  initial  form  of  the  linear  program  by 
pivoting. 

However,  Lemke’s  method  has  a  driving  variable  which  does  not  replace  $.  We  will 
now  compare  the  ratio  tests  done  by  the  self-dual  method  after  one  pivot  and  Lemke’s 
method  after  2  pivots. 

The  self-dual  method  performs  the  following  ratio  test  on  the  primal  variables: 


min  < 

i=2,...,m  ^ 

.  /  ~(bi  - 

■  min  <  — — 

t=2,...,m  ^  /j  — 

min  |  :  Cl2/.  _  aafx  >  o| 

1=2 (  ai2Ji  —  a»2/l  J 


(-EiQi 

(Eif)i 

~(&i  -  (a«2/ai2)fci) 

(0,2/012)/! 


*•  (Eif)i  >  o} 

:  fi  -  (a.2/ai2)/i  >  o| 


(3.10) 


When  i  =  l, 


(— E\b)i  b\/a\2 


(£./).  (3U) 
Since  the  ratio  test  is  only  considered  when  the  denominator  is  positive,  and  /i  >  0  and 
aj2  >  0  from  the  previous  iteration,  —  /1/012  <  0,  which  implies  that  t  =  1  has  no  effect 
on  this  ratio  test. 

The  self-dual  method  performs  the  following  ratio  test  on  the  dual  variables: 


min 

j=l,...,n 


=  min 

j=l,...,n 


f  Cj  -  (flij/ai2)c2  , 
\dj-{*\jl*\2)d2'  1 
t  aUcj -c,a<j 
(«12 Oj  “  <*lj<*2 


—  (ai>/ni2)d2  >  0 

-  <*ijd2  >0} 


(3.12) 

(3.13) 


The  dual  variable  for  uj  is  also  included  in  the  ratio  test,  when  d.2  >  0,  yielding  the  ratio 


C2/Q12  _  c2 
<*2/012  <*2 


(3.14) 


For  Lemke’s  method,  let 


3.16 


tu 


And  £4 


(&  /.)• 


Then,  after  one  pivot  on  Tableau  3.2,  the  following  tableau  is  obtained. 


( 


y\  is  now  the  driving  vmriAble.  The  next  pivot  is  on  the  (03,  yt)  element.  It  produces  the 
tableau 


At  this  point,  X3  is  the  driving  variable.  The  column  a  corresponding  to  x?  has 

{on/Zi,  if  *  =  1; 

(/*//i)<*ia  ~  «Mi  if*  =  2,...,m; 

<h//t,  if  i  =  m  +  2; 

{dj/fi)ai2  -  if  *  =  m  +  l,...,m  +  n,  k  ^  m  +  2,  j  =  k  -  m. 


Air  the  right-head  ride,  the  dement  is: 

|*i //it  if  *  =  1; 

(fk/ft)k 1  -  **,  if  k  =  2, . . . ,  m; 

(cs  +  (da//i)*i)/eta,  iffc  =  m  +  2; 

ei  +  Wi//»)*i  ~  («ifc/«ia)(ca  +  (<fa//i)*i)>  iffc  =  m+l,...,m  +  n, 

Jfc  /  m  +  2,  j  =  fc  -  m. 

(3.18) 

The  ratio  test  for  the  third  iteration  of  Lemke’s  method  will  be 

min  {RHS(*)/ok  :  ak  >  0}.  (3.19) 


We  now  wish  to  compare  the  results  of  the  self-dual  ratio  tests  (3.10), (3.13),  and  (3.14) 
after  one  pivot,  and  the  ratio  test  (3.19)  for  Lemke’s  method  after  two  pivots.  The  term 
“winner"  will  refer  to  the  index  of  the  variable  (or  the  variable  itself)  that  is  the  argument 
of  a  minimum  ratio  test.  We  will  do  the  following: 

(I)  Compare  the  winners  among  k  =  2, ...,m  in  (3.19)  and  (3.10).  Note  that  k  =  1 
corresponds  to  termination  of  Lemke’s  method. 

(II)  Compare  the  winners  among  fc  =  m  +  l,...,nin  (3.19)  and  (3.13)  or  (3.14). 

(Ill)  Compare  the  two  winners  in  (I)  and  (II). 

Lemma  3.3.  Without  loss  of  generality,  suppose  *  —  4  is  the  winner  of  the  aelf-dual  ratio 
test  (3.10)  for  i  =  2,...,m.  Then  k  —  4  ia  the  winner  of  the  Lemke  ratio  test  (3.19)  for 
fc  =  2,...,m. 


Proof.  Suppose  on  the  contrary  Jb  =  3  was  the  winner  of  the  Lemke  ratio  test  for  k  = 
2, . . . ,  m.  Then 

(/»//i)*i-63  (/4//l)6l-&4 

(fs/fl  )<*12  -  <*32  (/4//1  )<*12  -  <*42  ’ 


which  implies 


M  ~~  /i*s  Mi  —  /1&4 


<*12/3  -  <*32/1  <*12/4 —  <*42/1  ’  ^  ^ 

with  ( —  o*a  >  0  and  (/4//i)<*ij  -  04a  >  0  (by  equation  (3.19)).  Since  *  =  4  was 

the  winner  of  the  self-dual  ratio  test  (3.10)  for  *  =  2, . . .  ,m, 


<*42*1  ~  *4 <*12  032*1  ~  *3 <*12 

012/4  ”  043/1  012/3  —  032/1 


(3.22) 
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Note  that  the  Lemke  ratio  test  implies  that  the  denominators  agree  between  the  two 
methods.  The  difference  between  the  numerators  would  lead  one  to  believe  that  the  two 
tests  are  not  equivalent. 

Equation  (3.22)  implies  (after  cross  multiplication) 

01204261/3  —  012/364  —  03204261/1  +  012032/164  < 

81283261/4  —  0^2/463  —  83204261/1  +  012042/163,  (3.23) 

which  implies 

81261(042/3  —  032/4)  —  8i2(/}64  —  63/4)  +  012/1(83264  —  04263)  <  0,  (3.24) 

which  implies 

61(042/3  —  832/4)  —  3^>4  —  63/4)  +  /1  (03264  —  04263)  <  0.  (3.25) 

Equation  (3.21)  implies  (after  cross  multiplication) 

01261/3/4  —  812/163/4  —  04261/1/3  +  842/1 63  < 

81261/3/4  —  012/1/364  —  032/161/4  +  032/^64,  (3.26) 

which  implies 

0  <  /1 61(042/3  —  832/4)  —  /? (04263  —  03264)  +  812/1(63/4  —  /j64),  (3.27) 

which  implies 

0  <  61(042/3  —  832/4)  —  ai2(/364  —  63/4)  +  /1  (03264  —  04263).  (3.28) 

Statements  (3.25)  and  (3.28)  are  contradictory.  Hence  the  two  ratio  tests  must  declare  the 
same  winner.  | 

Lemma  3.4.  Without  ioss  0/ generality,  suppose  j  =  4  is  the  winner  of  the  self-dual  ratio 
teats  (3.13)  and  (3.14)  for  j  =  1, . . . ,  n.  Then  k  =  m-\-4  is  the  winner  of  the  Lemke  ratio 
test  (3.19)  for  k  =  m  +  1, . . .  ,m  +  n. 

Proof.  Throughout  this  proof,  the  relation  k  =  m+j  will  hold.  Hence,  we  can  interchange 
the  use  of  j  and  k  througout  the  proof.  Suppose  j  =  4  is  not  the  winner  of  the  Lemke 


13 


ratio  test.  There  are  two  cases  to  consider,  depending  upon  whether  the  winner  j  is  j  =  2 
or  j  ^  2,  which  will  correspond  to  using  equations  (3.14)  and  (3.13)  respectively. 

Case  1:  j  ^  2  is  the  winner.  Without  loss  of  generality,  assume  j  =  3  is  the  winner. 
The  Lemke  ratio  test  (3.19)  implies: 


Ca  ~  +  h  ~  fjfo)  .  c*  ~  +  ~ 

d*  _  if*  _  d.A  fit  * 


7f«!2  -  Tfais 


t°12  -  7i  14 


(3.29) 


which  implies 

C3/l  ~  %Sc2h  +  7^(^3012  -  013^2)  C4/1  -  f^C2/l  +  ^(<*4012  -  «14d2) 


“3O12  —  «2a13  dAa\2  —  d2Oi4 


which  implies 


_  “ia, 


C4  -  f^c2 
»n  * 


d$a\2  —  d2ai3  d4a12  —  d2ai4 
Since  j  =  4  was  the  winner  of  the  self-dual  ratio  test  (3.13), 

012C4  —  c2ai4  .  01203  —  c2ai3 


01204  —  aMd2  ax2«3  —  and2 
Since  ai2  >  0,  equation  (3.32)  contradicts  equation  (3.31).  So,  for  the  first  case,  fc  =  m  +  4 
must  be  the  winner  of  the  Lemke  ratio  test  (3.19). 

Case  2:  k  =  m  +  2  is  the  winner  of  the  Lemke  test  (3.19).  Then  d2  >  0.  The  ratio 
test  implies 

(c2  +  (d2//x)6x)/ax2)  ^  c4  —  (ax4/ax2)c2  -f  {b\/f{){dA  —  (014/012)^2) 


which  implies 


which  implies 


(^4/ f\ )®12  —  (rf2//l)Ol4 


c2/i  <  C4/1  —  {auf 012)02/1 
d2a  x2  dAa\2  —  d2ai4 


£l  <  °12C4  —  C2P14 
d2  0x2^4  —  0x4  <f2 


The  self-dual  ratio  tests  (3.13)  and  (3.14)  imply: 


Q12C4  ~  C20l4  £2 
a\2dA  —  ax4d2  d2 


(3.34) 


(3.35) 


(3.36) 


Statements  (3.35)  and  (3.36)  are  contradictory.  Hence  k  =  m  +  4  must  be  the  winner  of 
the  Lemke  test.l 


>  **»■*». 


•  v 


V1 


r'X'.r*.*  *  *  •  t 


Corollary.  It  the  duel  variable  for  uj  wins  the  aelf-dual  ratio  teat  (3.13)  and  (3.14)  among 
the  dual  variables,  then  k  =  m  +  2  will  win  the  Lemke  ratio  teat. 

Proof.  Similar  to  Lemma  3.4,  Case  2.| 

We  will  now  compare  the  winners  of  the  primal  and  dual  ratio  tests. 

Lemma  3.5.  Without  loea  at  generality,  assume  t  =  3  is  the  overall  winner  ot  the  self-dual 
ratio  tests  (3.10),  (3.13)  and  (3.14)  between  the  primal  and  the  dual  variables.  Then  k  =  3 
is  the  overall  winner  in  the  Lemke  ratio  teat  (3.19)  tor  k  =  1, . . . ,  m  +  n. 


Proof.  Without  loss  of  generality,  assume  that  t  =  3  and  j  —  4  are  the  winners  among 
the  primal  and  dual  variables,  respectively,  in  the  self-dual  ratio  tests.  By  Lemmas  3.3 
and  3.4,  k  =  3  and  Jb  =  m  +  4  are  the  winners  for  the  two  Lemke  ratio  tests  (3.19)  among 
k  =  1, . . . , m  and  Jb  =  m  -f  1, . . .  ,m  +  n,  respectively.  For  the  self-dual  ratio  test,  the  ratio 
for  i  =  3  must  be  less  than  the  ratio  for  j  =  4.  On  the  contrary,  if  Jb  =  3  is  not  the  overall 
winner  for  the  Lemke  test,  then  Jb  =  m  -f  4  must  be.  The  Lemke  test  (3.19)  then  implies 


C*  ~  +  T^4  “  ^  fa1  ~  63 


%al7  -  £«i4 


-  <*32 


(3.37) 


which  implies 


which  implies 


hc*  ~  +  ]n_  <  hh  -  b3fi 

d.4012  —  d2<*u  <*12  012/3  —  <*32/1  ’ 


(3.38) 


O12/1C4  —  <*14/lC2  012/361  ~  ~  frl(°I2/s  ~  g32/l) 

d4<*i2  —  d2<*!4  012/3  —  O32/1 


(3.39) 


which  implies 


/l(oi2C4  —  O14C2)  <  /l (03261  —  63012) 
d4®!2  —  d2<*!4  O12/3  —  O32/1 


The  self-dual  ratio  test  implies 


(3.40) 


03261  —  63012  012C4  —  014C2 

O12/3  ~  O32/1  d40l2  —  d20u 


(3.41) 


Since  f\  >  0,  (3.40)  and  (3.41)  are  contradictory.  Hence  Jb  =  3  must  be  the  overall  winner.  | 
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Lemma  3.6.  If  j  =4  is  the  aver mil  winner  of  the  self-dual  ratio  teats  (3.10)  and  (3.13), 
then  k  =  m  +  4  is  the  overall  winner  of  the  Lemke  ratio  test  (3.19). 

Proof.  Similiar  to  Lemma  3.5. | 

Lemma  3.7.  If  the  dual  variable  on  ui  is  the  overall  winner  of  the  self-dual  ratio  tests 
(3.10),  (3.13)  and  (3.14),  then  k  =  m  +  2  is  the  overall  winner  of  the  Lemke  ratio  test 
(3.19). 


Proof.  Suppose  on  the  contrary  t  —  3  is  the  winner  among  the  primal  variables  of  the  self¬ 


dual  ratio  test  (3.10),  and  that  u\  is  the  winner  among  all  the  dual  variables.  By  Lemmas 
3.3  and  3.4,  it  =  3  and  k  =  m  +  2  are  the  winners  in  the  Lemke  ratio  test  (3.19)  among 
k  =  1, . . . , m  and  k  =  m+  l,...,m  +  n,  respectively.  The  self-dual  ratio  test  implies: 


c2  _  03261  —  63013 
dj  012/3  —  033/1 

(3.42) 

The  Lemke  ratio  test  implies 

/s&i  -  fibs  _  (®*  +  <*2$J-)/<*12 

(3.43) 

<>12/3—0*2/1  <fe//i 

which  implies 

—b\  t  fsb%  —  /163  ^  C2/1 

a12  <*12/3  —  O32/1  Oi ' 

(3.44) 

which  implies 

—61(012/3  —  032/1)  +  /*6lOi2  —  /163O12  „  C2/1 
<*12/3  -  0*2/1  d2 

(3.45) 

which  implies 

0*2/161-/163012  „  c2/i 

012/*  —  032/1  dj 

(3.46) 

Since  f\  >  0,  (3.42)  and  (3.46)  are  contradictory.  Hence  k  =  m  +  2  must  be  the  overall 
winner  of  the  Lemke  ratio  test.| 


We  have  now  shown  the  following:  If  Lemke’s  method  is  executed  in  a  normal  manner, 
x a  will  become  the  driving  variable  on  the  third  iteration.  The  same  variable  will  block  x2 
as  if  X}  replaced  i,  and  then  Lemke’s  method  was  restarted  from  the  new  skew-symmetric 
form,  with  a  ratio  test  done  between  the  column  RHS  and  6.  But  this  form  is  equivalent 
to  restarting  the  self-dual  method  after  one  iteration.  If  the  self-dual  method  takes  i 
iterations,  this  argument  can  be  used  for  each  t  =  1, 2,. . .  t,  since  the  inductive  assumptions 
will  hold  on  each  of  these  iterations.  Hence  we  have  proved: 


Theorem.  Assume  that  Dantsig’s  self-dual  parametric  algorithm  is  executed  on  (1.1) 
and  that  Lemke’s  algorithm  is  executed  on  (1.2)  and  an  optimal  solution  is  found  by  the 
self-dual  method  in  £  iterations.  Then  the  pivots  of  iteration  t  of  the  self-dual  algorithm 
correspond  in  a  precise  way  to  the  pivots  of  iterations  2t  -  1,  2t  and  2t  +  1  of  Lemke’s 
algorithm,  for  t  —  1,  2, . . . ,  t. 

Note  that  Lemke’s  method  will  take  2t  +  1  iterations.  The  extra  pivot  comes  when 
finding  the  optimal  solution,  when  the  last  driving  variable  replaces  B. 

4.  An  Example 

In  this  section,  we  give  an  example  to  illustrate  the  theorem.  In  the  tableaus  the  angle 
brackets  ()  indicate  the  next  pivot  that  will  occur.  Consider  the  linear  program 

minimize  4*i  —  3x2 
subject  to  —  2*i  —  2*2  >  —19 
*i  —  *2  >  1 

— *i  +  2*2  >  2 

*i,*2  >0 

The  initial  tableau  corresponding  to  Tableau  3.1  for  the  self-dual  method  is  set  up  as 
follows: 


Xl 

*2 

«2 

«3 

RHS 

FBAR 

«1 

2 

2 

1 

0 

0 

19 

0 

u  2 

-1 

(1) 

0 

1 

0 

-1 

1 

1 

-2 

0 

0 

1 

-2 

1 

Z 

4 

-3 

0 

0 

0 

DBAR 

0 

1 

0 

0 

0 

B  —  +00 

Tableau  4.1 


6  is  decreased  from  +  oo  and  is  blocked  by  the  reduced  cost  for  at  a  value  =  3.  *2  is 
the  incoming  nonbasic  variable  and  the  ratio  test  indicates  that  U2  is  the  variable  that  *2 
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will  replace.  The  pivot  is  performed,  yielding  the  tableau 


*1 

*2 

«2 

u3 

RHS 

FBAR 

til 

a 

mm 

21 

-2 

*2 

K3 

n 

-1 

1 

«» 

Q 

□ 

-4 

3 

z 

1 

KB 

mm 

3 

0 

DBAR 

1 

O 

0 

-1 

EH 

8  =  3 

Tableau  4.2 


After  interchanging  the  columns  for  u2  and  j2  of  this  tableau,  we  arrive  at  a  tableau  that 
corresponds  to  Tableau  4.1: 


*1 

«2 

«i 

xj 

»I3 

RHS 

FBAR 

«i 

4 

-2 

1 

0 

BVjj 

21 

-2 

I  *2 

-1 

1 

0 

1 

-1 

1 

«s 

<-l) 

2 

0 

0 

-4 

3 

z 

1 

3 

MM 

KB 

ft'Bti 

DBAR 

1 

-1 

0 

0 

0 

8  =  3 

Tableau  4.2a 

At  this  point,  all  the  reduced  coats  are  positive  for  0  <  8  <  3.  Hence,  8  is  reduced  to  a 
value  of  since  it  is  blocked  by  the  primal  basic  variable  U3.  The  dual  simplex  method 
is  invoked,  and  xi  replaces  us  in  the  set  of  basic  variables.  The  pivot  is  performed  on 
Tableau  4.2,  yielding  the  tableau: 


*1 

Xj 

«i 

«2 

tis 

RHS 

FBAR 

tii 

0 

0 

1 

6 

4 

5 

10 

*2 

0 

1 

0 

-1 

-1 

3 

-2 

*1 

1 

0 

0 

-2 

-1 

4 

-3 

z 

0 

0 

0 

5 

1 

DBAR 

0 

0 

0 

1 

1 

II 

Tableau  4.3 


Note  that  aU  the  reduced  costs  and  primal  variables  are  nonnegative  for  8  =  0,  and  hence 
the  optimal  solution  has  been  found.  This  table  can  be  rearranged  by  interchanging  the 
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columns  to  yield  a  tableau  that  corresponds  to  Tableau  4.1: 


u2 

u3 

X2 

Xi 

RHS 

FBAR 

Ul 

HI 

mm 

0 

TiW| 

mm 

■■ 

x2 

9g] 

HI 

1 

flH 

msm 

*1 

H 

ifl 

0 

KH 

Him 

z 

5 

l 

o 

0 

IK 

i 

DBAR 

1 

i 

D 

0 

0 

II 

Tableau  4.3a 

For  Lemke’s  method,  the  initial  tableau  is: 


«i 

ti2 

«3 

Vi 

v2 

yi 

V2 

y3 

Xi 

x2 

6 

RHS 

mm 

i 

El 

■9 

O 

mm 

m 

■f 

2 

2 

19 

mm 

wm 

i 

H 

u 

1 1 

0 

0 

-1 

1 

-1 

mm 

■a 

El 

i 

o 

M 

0 

1 

-2 

-i 

-2 

mm 

0 

0 

o 

1 

-2 

1 

-1 

WK 

0 

4 

n 

0 

0 

0 

i 

-2 

-1 

2 

0 

(-1) 

-3 

Tableau  4.4 


On  the  first  iteration,  6  is  the  entering  basic  variable.  It  replaces  v2  in  the  set  of  basic 
variables  and  produces  the  tableau: 


«1 

«2 

«3 

«1 

t>2 

Vl 

V2 

y3 

Xj 

x2 

9 

RHS 

1 

0 

2 

2 

0 

19 

«2 

1 

1 

-1 

2 

1 

-2 

-1 

(1) 

0 

2 

«3 

mm 

1 

-1 

2 

1 

-2 

1 

-2 

0 

1 

1 

-2 

1 

-1 

0 

0 

0 

4 

$ 
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2 
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-2 

0 

0 

1 
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Tableau  4.5 


The  complement  of  v2,  namely  x2,  is  now  the  entering  basic  variable.  It  replaces  u2  in  the 
set  of  basic  variables  and  produces  the  tableau: 


«2 

U3 

Vl 

v2 

yi 

y2 

y3 

X\ 

x2 

* 

RHS 
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1 
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o 
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-2 
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4 

0 
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H 

H 

mm 

2 

1 

-2 

-1 

1 

El 

2 

mm 

0 

2 

i 

-3 

6 

(3) 

-6 

-1 

0 

0 

5 
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B1 

H 

0 

-2 

1 

-1 

0 

0 

0 

4 

u 

0 

n 

D 

D 

-1 

2 

1 

-2 

0 

0 

1 

3 

Tableau  4.6 


The  complement  of  u2,  y?,  is  now  the  entering  basic  variable.  To  show  the  correspondence 
to  Tableau  4.2a,  we  pivot  pj  into  the  basis  for  0,  rearrange  the  columns,  and  produce  the 
tableau: 


«1 

x2 

U3 

Vi 

VS 

Vi 

Vj 

V3 

X\ 

ti2 
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RHS 

«1 

1 

0 
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0 

0 

0 

0 

0 

4 

-2 

2 

21 

x2 

0 

1 

0 

0 

0 

0 

0 

0 

-1 

1 

-1 

-1 
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0 

0 

1 

0 

0 

0 

0 

0 

-1 

2 

-3 

-4 

Vl 

0 

0 

0 

1 

0 

-4 

1 

1 

0 

0 

-1 

1 

Vi 

0 

0 

0 

0 

1 

2 

-1 

-2 

0 

0 

1 

3 

Tableau  4.6a 


t/2  is  the  driving  variable  in  Tableau  4.6  and  replaces  U3  in  the  set  of  basic  variables  to 
produce  the  tableau: 
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0 
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-1 
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-2 
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0 
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vi 

0 
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1 

1 

-4 

0 

1 

1/3 

0 
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9 

0 
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0 

0 

0 

0 

0 
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0 

1 

4/3 

Tableau  4.7 


The  complement  of  tij,  yj,  is  now  the  entering  basic  variable.  It  replaces  t>i  in  the  set  of 
basic  variables  and  produces  the  tableau: 
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1 

-4 

0 

1 
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0 
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9 

0 

-2/3 

-1/3 

0 

0 

0 

0 

0 

1/3 

0 

1 

4/3 

Tableau  4.8 


The  complement  of  t>i,  xj,  is  now  the  entering  basic  variable.  It  replaces  9  in  the  set  of 


basic  variables  and  produces  the  optimal  tableau: 
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V2 
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*i 
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0 
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4 
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0 

0 

0 

0 

0 
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0 

-1 

-1 
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Bh 

0 

0 

0 

0 

1 

2 

EM 

0 

0 

0 

H 

1 

-6 

1 

0 

0 

0 

-1 

y3 

0 

0 

0 

i 

1 

-4 

0 

l 

0 

0 

-1 

1 

Xi 

0 

-2 

-1 

□ 

mm 

0 

0 

0 

l 

0 

3 

4 

Tableau  4.9 


By  reordering  the  columns  of  this  tableau,  we  get  a  tableau  that  corresponds  to  Tableau 
4.3a. 

The  following  chart  compares  the  pivots  done  in  each  method.  For  each  pivot,  the 
notation  (a,  b)  indicates  that  6  replaces  a  in  the  set  of  basic  variables  by  an  explicit  pivot. 
For  the  self-dual  method,  the  notation  (a,  6)  indicates  that  b  replaces  a  by  an  implicit 
pivot. 


f  Self- Dual 

Lemke 

Itn 

Pivot 

Pivot 

Itn 

1 

(U2,*2) 

(t>2,y2) 

(V2J) 

(«2,*2) 

(«3,y2) 

(v^ys) 

(01 X1 ) 

1 

2 

3 

4 

5 

2 

(u3,*i) 

(vi^ys) 

It  is  interesting  to  note  how  the  third  iteration  of  Lemke’s  method  “links”  the  first 
and  second  iterations  of  the  self-dual  method. 
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